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A GENERAL STRONG LAW OF LARGE NUMBERS AND 
APPLIGATIONS TO ASSOGIATED SEQUENGES AND TO 
EXTREME VALUE THEORY 

HAROUNA SANGARE AND GANE SAME LO 


Abstract. The purpose of this paper is to establish a general strong law 
of large numbers (SLLN) for arbitrary sequences of random variables (rv’s) 
based on the squared indice method and to provide applications to SLLN of 
associated sequences. This SLLN is compared to those based on the Hajek- 
Renyi type inequality. Nontrivial examples are given. An interesting issue 
that is related to extreme value theory (EVT) is handled here. 


1. Introduction 

In this paper, we present a general SLLN for arbitrary rv’s and partic¬ 
ularize it for associated sequences. In the recent decades both strong 
law of large numbers and central limit theorem for associated sequences 
have received and are still receiving huge interests since Lebowitz m 
and Newman [TJ] results under the strict stationarity assumption. The 
stationarity assumption was dropped by Birkel pQ, who proved a ver¬ 
sion of a SLLN that can be interpreted as a generalized Kolmogorov’s 
one. A recent account of such researches in this topic is available in m- 
Although many results are available for such sequences, there are still 
many open problems, especially regarding nonstationary sequences. 

We intend to provide a more general SLLN for associated sequences as 
applications of a new general SLLN for arbitrary rv’s. This new general 
SLLN is used to solve a remarkable issue of extreme value theory by 
using a pure probabilistic method. 

Here is how this paper is organized. Since association is the central 
notion used here, we hrst make a quick reminder of it in section [2l In 
section [3l we make a round up of SLLN’s available in the literature 
with the aim of comparing them to our hndings. In section 01 we state 
our general SLLN for arbitrary rv’s and derive some classical cases. 
In section 01 we give an application to EVT where the continuous 
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Hill’s estimator is studied by our method. The section |6] concerns the 
conclusion and some perspectives are given. The paper is ended by the 
Appendix section, where are postponed the proofs of Propositions |2] 
and [3] stated in section [5l 

To begin with, we give a short reminder of the concept of association. 

2. A BRIEF REMINDER OF THE CONCEPT OF ASSOCIATION 

The notion of positive dependence for random variables was introduced 
by Lehmann (1966) (see [12]) in the bivariate case. Later this idea was 
extended to multivariate distributions by Esary, Proschan and Walkup 
(1967) (see [5]) under the name of association. The concept of associ¬ 
ation for rv’s generalizes that of independence and seems to model a 
great variety of stochastic models. This property also arises in Physics, 
and is quoted under the name of FKG property (Fortuin, Kastelyn and 
Ginibre (1971), see [7]), in percolation theory and even in Finance (see 
M)- The dehnite dehnition is given by Esary, Proschan and Walkup 
(1967) (see [5]) as follows. 

Definition 1. A finite sequence of random variables (Xi,...,X„) is 
associated if for any couple of real and coordinate-wise non-decreasing 
functions f and g defined on M”, we have 

(2.1) Cov{f{X,,...,X^), g{X,,...,Xn))>0 

whenever the covariance exists. An infinite sequence of random vari¬ 
ables is associated whenever all its finite subsequences are associated. 

We have a few number of interesting properties to be found in (Cl) : 

(PI) A sequence of independent rv’s is associated. (P2) Partial sums 
of associated rv’s are associated. (P3) Order statistics of independent 
rv’s are associated. (P4) Non-decreasing functions and non-increasing 
functions of associated variables are associated. (P5) Let the sequence 
Zi, Z 2 ,..., Zn be associated and let (ai)i<i<„ be positive numbers and 
{bi)i<i<n real numbers. Then the rv’s afiZi — bi) are associated. 

As immediate other examples of associated sequences, we may cite 
Gaussian random vectors with nonnegatively correlated components 
(see [T6|) and homogeneous Markov chains (see 0)- 

The negative association was introduced by Joag-Dev and Proschan 
(1983) (see [10]) as follows 
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Definition 2. The variables Xi,...,Xn are negatively associated if, 
for every pair of disjoint subsets nonempty A, B of A = 

{ii, ...,im}, B = {im+i, ■■■An} and for every pair of coordinatewise non¬ 
decreasing functions f : M”* —?■ M and g : M”""* M, 

(2.2) Cov{f{X„ z e A), g{Xi, t e B)) < 0 

whenever the covariance exists. An infinite collection is said to be neg¬ 
atively associated if every finite sub-collection is negatively associated. 

Remark 1. For negatively associated seguences, we have ^2.Sfl . so the 
covariances are non-positive. This remark will be used in sub-subsection 

A usefull result of Newman (see [13]) on assocation, that is used in this 
paper, is the following 

Lemma 1 (Newman [I3]). Suppose that X andY are two random vari¬ 
ables with finite variance and, f and g are complex valued functions 
on with bounded derivatives f and g'. Then 

\CovU{X), g{Y))\ < \\f\\oo\\ 9 '\\ooCov{X, Y). 

Here, we point out that strong laws of large numbers and, central 
limit theorem and invariance principle for associated rv’s are available. 
Many of these results in that field are reviewed in Ha- Such studies go 
back to Lebowitz (1972) (see [H]) and Newman (1984) (see [IS]). As 
Glivenko-classes for the empirical process for associated data, we may 
cite Yu (1993) (see [20]). We remind the results of such authors in this 


Theorem 1 (Lebowitz [H] and Newman USD- Let Xi, X 2 , ■ ■ ■ be a 
strictly stationary seguence which is either associated or negatively as¬ 
sociated, and let T denote the usual shift transformation, defined so 
thatT{f{Xj^,...,XjJ) = f{Xj^+i,...,Xj^+i). ThenT is ergodic (i.e., 
every T-invariant event in the a-field generated by the Xj’s has proba¬ 
bility 0 or 1) if and only if 

1 " 

(2.3) lim — cov(Xi, XA = 0. 

n —>+00 n ^ 

J=1 

In particular, if (fH^) is valid, then for any f such that f{Xi) is Li, 
lim — /(Xj) = E (/(Xi)) almost surely (a.s). 

n —>-+00 Tl 

2=1 

Now we are going to state some classical SLLN’s for arbitrary rv’s in 
relation with Hajek-Renyi’s scheme. 




4 


HAROUNA SANGARE AND GANE SAME LO 


3. Strong laws of large numbers 


For independent rv’s, two approaches are mainly used to get SLLN’s. 
A direct method using squared indice method seems to be the oldest 
one. Another one concerns the Kolmogorov’s law based on the maximal 
inequality of the same name. Many SLLN’s for dependent data are 
kinds of generalization of these two methods. Particularly, the second 
approach that has been developed to become the Hajek-Renyi’s method 
(see 0), seems to give the most general SLLN to handle dependent 
data. Since we will use such results to compare our hndings to, we 
recall one of the most sophisticated forms of the Hajek-Renyi setting 
given by Tomacs and Libor (see [12]) denoted by {GCHR). These 
authors introduced a Hajek-Renyi’s inequality for probabilities and, 
subsequently, got from it SLLN’s for random sequences. They obtained 
hrst : 

Theorem 2. Letr he a positive real number, a„ be a sequence of non¬ 
negative real numbers. Then the following two statements are equiva¬ 
lent. 

(i) There exists (7 > 0 such that for any n G N and any £ > 0 



(a) There exists C > 0 such that for any nondecreasing sequence 
{bn)neN of positive real numbers, for any n G N and any e > 0 



where Sn = Yl'i=i n G K. 

And next, they derived this SLLN from it. 


Theorem 3. Let a„ and he non-negative sequences of real numbers 
and let r > t). Suppose that is a positive non-decreasing, unbounded 
sequence of positive real numbers. Let us assume that 



and there exists C > 0 such that for any n G M and any e > 0 
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Then 

V n 

hm — = U a.s. 

n—>+oo Oji 

For convenience, introduce these three notations. We say that a se¬ 
quence of random variables Xi, X 2 ,... has the P — max — variance{r) 
property, with r > 0, if and only if there exists a constant C* > 0 such 
that for any hxed n > 1, for any A > 0, 

P(max(|5i|,...,|5„|) > A) < C A”" Var(5„). 

It has the Var — max — variance{r) property, with r > 0, if and only 
if there exists a constant C > 0 such that for any hxed n > 1, 

Var(max(|^i|,..., |^„|))2/'- < C Var(5„) 

and it has the E — max — variance{r) property, with r > 0, if and only 
if there exists a constant C > 0 such that for any hxed n > 1, 

(E (maxd^il,..., < C- Var(5„). 

In the sequel we will say that max — variance property is satished if 
one of the three above max — variance properties holds. 


Theorem [2] leads to these general laws. 

Proposition 1. Let Xi, X 2 ,... he a sequence of centered random vari¬ 
ables. Let {hk)k>i he an increasing and nonbounded sequence of positive 
real numbers. Assume that 

(3.1) lim sup b~^cov{Xi^ Sn) < +cxd 

„^+oo 

and the sequence has the ¥ — max — variance{r) property, r > 0. Then 
Sn/bn —t 0 a.s. as n ^ -|-cx3. 

If the sequence has the War — max — variance{2) property or the E — 
max — variance{2) property and if'^i>ib~‘^'^j^^Cov{Xi,Xj) < -|-cxo, 
then Sn/bn — t 0 a.s. as n ^ -|-oo. 


Remark 2. Here, lid. 1\) is called the general condition of Hdjek-Renyi 
{GCHR). 

Proof. If the sequence has the E — max — variance{r) property, then 
there exists a constant C > 0 such that for any hxed n > 1 , for any 
A > 0, and for r = 2, 

P(max(|S'i|,..., \Sn\) > A) < A“^Var(max(|S'i|,..., |S'„|)) 
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< A-^E (max(|^i|,...,|^„|))' 


< CA-"Var(^„) = CA”" ^ 

i=l 


Y,Cov{X,, X,) 
-i=i 


The conclusion conies out by taking ai = YTj=i Cou(A, X^ 
Cov{Xi, Sn) in the Hajek-Renyi’s Theorem [2] and applying Theorem^ 


It is worth mentioning that the Hajek-Renyi’s inequality is indeed very 
powerfull but, unfortunately, it works only if we have the max — 
variance property. For example, the E — max property holds for 
strictly stationary and associated sequences (see m)- 

As to the squared indice method, it seems that it has not been suffi¬ 
ciently standed to provide general strong laws for dependent data. We 
aim at hlling such a gap. 


Indeed, in the next section, we provide a new general SLLN that in¬ 
spired by the squared indice method. This SLLN will be showed to have 
interesting applications when comparing to the results of the present 
section. 


4. Our results 

In this section, we present a general SLLN based on the squared indice 
method and give different forms in specihc types of dependent data 
including association with comparison with available results. The result 
will be used in section O to establish the strong convergence for the 
continuous Hill’s estimator with in the frame of EVT. 


Theorem 4 . Let Xi,X2, ■ ■ ■ be an arbitrary sequence of rv’s, and let 
(/i,n)j>i be a sequence of measurable functions such that War [f{Xi^n)] < 
-fcx), for i > I and n> 1 . If for some h, 0 < 5 < 3, 


(4.1) Cl = sup sup Var 


n>0 q>l 


(3-<5)/4 


Q 


fi, n{Xi) I < -FcX) 


2 = 1 


and for some 5, 0 < 5 < 3, 
(4.2) 


j-qWi 


C2 = sup sup sup sup War . fq2+i^ „ {Xq2+i) 

n>0 k>l q : q2+ l<k<{q+l)‘^ l<j<k \ 


< -t-oo 


2=1 
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hold, then 

1 

n 


U'i, n{Xi) - E (/i, n(^i))) — >0a.sasn —+cx). 


2=1 


Remark 3. We say that the sequence Xi,X 2 ,-- - satisfies the 
{GCIP) whenever fl4.ip and fl4.2p hold. 

Proof. It suffices to prove the announced results for Yi = fi^ and 
E(yi) = 0, i > 1. Observe that omitting the subscript n does not cause 
any ambiguity in the proof below. We have 


P 


k 


2=1 


>k-f^\ < P 


2=1 


> k^-^ < 


kW-0) 


War ( 


, 2=1 


We apply this formula for k = and get for 0 < 5 < 3, 


P 




2=1 


> q 


-2/3 




q 


2=1 


—4/3 


War 


(3-5)/2 


q 


Yy]- 


2=1 


and there exists G N* such that for q > q^ 


P 




2 = 1 


>I < 


q 


l+(5-4/3 ■ 


Then we have for fi < (5/4), ^ > q 

conclude that 


(4.3) 


^ i=l 


0 a.s. 


Now set q'^ < k < {q + Ifi and g = 0 if A; = and 1 otherwise. We 
have 


. k k 2 2 

lYy-T.Yy-iYy-lYy^lYy-^.Yy 


2=1 


2=1 


k 


2=1 

Y 


2 = 1 


k 


2=1 2=1 


q^ 


2 = 1 


2=1 
2 


2=1 




k 
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(4.4) 


q 





z=l 



But — A:)//c —)■ 0 as g —)■ +cx3. This combined with fl4.3p proves that 
the second term of fl4.4p converges to zero a.s. It remains to handle 
the hrst term. Notice that we let g — )■ +cxd and then k{q) dehned by 
g(/c)^ < k < {q{k) + 1)^ also goes to inhnity. Then, for 0 < 5 < 3, 


P 




< P 


E 

k 

^k, q ^ ^ 
i=g2 + l 


> k^-f^ < P 




- E 


> k^-^ 


> q 


2(1-13) 


S I E 


< 


Cfc, q 


q 


l+(5-4/3 


Var 


(3-<5)/2 


q 


E 


< 


^i=g2 + l 

^k, qC2 


i=q2 + l 
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1+5-4/3 ■ 


Now for 0 < /? < 5/4, P g I]Lg 2 +i E <+co. Then 


(4.5) 




E^'-E^'- 

2=1 2=1 


0 a.s. 


Now in view of fl4.3p . fl4.4p and fl4.5p and since {q^ — k)/k —)■ 0, we may 
conclude the proof. 


Remark 4. In most cases, conditions fl4.ip and fl4.2p are used for 
6 = 1, as it is the case for the independent and indentically distributed 
random variables. We will exhibit a situation in Proposition [H that 
cannot be handled without using fl4.ip and fl4.2p for 5 < 1. 

4.1. Comparison and particular cases. Let us see how {GCIP), 
that is fulhlment of conditions fl4.ip and fl4.2p . works in special cases. 
We have to compare our (GCIP) to {GGHR). But {GGHR) is used 
only when max — variance property is satished. We only consider the 
case where Xi, X 2 , ■ ■ ■ are real and the ffs are identity functions. 


4.1.1. Independence case. By using Theorem |2l we observe that we 
have the P — max — variance{2) property, that is the Kolmogorov’s 
maximal inequality. By using the Hajek-Renyi’s general condition, we 
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have the strong law of large numbers of Kolmogorov : Sn/n —>■ 0 a.s. 
whenever 


(4.6) E Nar{Xn)/n^ < +oo. 

n>l 

To apply Theorem 0] here, we notice that the sequence of variances 
Yar{Sn) is non-decreasing in n. Then (14.11) and (14.2^ are implied by, 
for some 0 < and 0 < z/ 2 . 


sup 

k>l 


1 


k 

^^Var(Xi) < -|-oo and sup 


1 

/j2+i/2 


(fc+l)2 

Var(Xj) < -foo. 

i=k'^+l 


But, by observing that the latter is 


(fc+i)^ 

^-( 2 +^^ 2 ) Yar{Xi) = 

i=k‘^ 


(A:+l)2 e 

Y, Var(X,)-5^Var(X,) 


2=1 


2=1 


we conclude that the SLLN is implied by 


(4.7) 


1 


sup 

k>l 


kl+y 


k 

^^Var(Xj) < -foo, 
2 = 1 


for some z/ > 0. In the independant case, one has the SLLN for 
^^^1 Var(Xj) —)■ cr^. And the parameter v in fl4.7p is useless in 
that case. But the availability of the parameter v is important for 
situations beyond the classical cases. As a first example, let us use 
the Kolmogorov’s Theorem and construct a probability space holding 
a sequence of independent centered rv’s Xi,X 2 , • • • with 
But (14.7p does not hold for z/ = 0 since 

— > 7 — l) —>■ -foo, as n —>■ -|-oo 

4 — ^ 'J i 


while (GCHR) entails the SLLN. 


We will consider in proposition |2] below an important other example 
which cannot be concluded unless we use a positive value of z/. Now, if 
we may take u = 1/3, we have that bounded and 

our Theorem also ensures the SLLN. 


Now if the sequence is second order stationary, then fl4.ip and (14.21) are 
both valid. Also, if the variances are bounded by a common constant 
Co, both (14.ip and (14.2p are valid. 
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4.1.2. Pairwise negatively dependent variables. In that case, we may 
drop the covariances in {GCIP) and then fl4.ip and 04.21) lead to 04.7p 
as a general condition for the validity of the SLLN in the independent 
case. As to {GCHR), we don’t have any information whether or not 
the max — variance property holds. 


4.1.3. Associated sequences. Here Var(S'„) is non-decreasing in n and 
{GCIP) becomes for u = {1 — 6)/2 > 0 with 0 < 5 < 1 

<? 


(4.8) 

and 

(4.9) 


sup 
<?>! I 


1 


l+i' 


Yar I I < -|-cx) 


. i=l 


sup 
<?>! I 


2(l+i/) 


/ (9+1)' 

Yar I Xi 1 < -|-cx). 


y=ij2+i 

If the sequence is second order stationary, then 04.Sp implies 04.9p . since 


Q 


2(l+i/) 


/ (9+1)' 

Yar 


(2g + 1) 


i+i' 




j(i+i^) 


q 


Yar 


2(1+!^) 


l + u 


J^{l+u)l2 


(24+1) 

E+). 

i=i / 


/2q+l 

Yar ( 


for fc = 2g -|- 1. And 04.Sp may be witten as 


(4.10) sup 
9>i q 


1 


Var(Xi) + - y (g - z -fl) Cov{Xi, X^) 
q 


i=2 


< -fCX). 


This is our general condition under which SLLN holds for second order 
stationary associated sequence. Then, by the Kronecker lemma, we 
have the SLLN if 

+ 0O 

(4.11) cr^ = Var(Xi) + 2 ^ Cov{X^, Xi) < -7cx). 

i=2 

Condition 04.111) is obtained by Newman [Hj. Clearly, by the Cesaro 
lemma, 04.111) implies 


1 

(4.12) lim - VCon(Xi, Xd ^ 0. 

g—>+oo q 

2=1 

And, in fact, the latter is a necessary condition of strong law of large 
numbers as proved in Theorem 7 in [15], from the original result of 
Lebowitz (see my 
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The reader may find a larger review on this snbject in DU- Onr result 
seems more powerful since we may still have the strong law of large 
numbers even if cr^ = +oo. 


We only need to check condition fld.lOp . We will comment this again 
after Proposition O 


For strictly stationary associated sequences with finite variance, we 
have the E — max — variance{2) property (see [H]). Then {GCHR) 
may be used. It becomes 


(4.13) 


lim sup Con (Xj, 


2=1 


Sn) < + 00 , 


which is equivalent to 


lim sup 

n 


E 


Var(Xi) 


n / n—j+1 

+E E 


j=2 \ i=l 




Cov{Xi, Xj) 


and reduces to 


H-OO 

^Con(Xi, Xj) < +00. 
i=2 


< +00 


We then see that {GCHR) gives weaker results than ours. Indeed, in 
our formula fid.iop . we did not require that ^ (O' “ * + 1) Con(Xi, 

Xj) is bounded. It may be allowed to go to infinity at a slower con¬ 
vergence rate than q~'^. Then our condition fId.lOp besides being more 
general, applies to any associated sequences and is significantly better 
than the {GCHR) for strictly stationary sequences. 


Nevertheless, for fl4.13l) . it is itself more powerfull than Theorem 6.3.6 
and Corollary 6.3.7 in im, due to the use of Theorem |2] and Proposi¬ 
tion [H of Tomacs and Libor (see Hi). Such a result is also obtained 
by Yu (1993) (see [20]) for the strong convergence of empirical distri¬ 
bution function for associated sequence with identical and continuous 
distribution. 


Birkel (see m) used direct computations on the convariance structure 
for associated variables and got the following condition 


lim sup —Cov{Xi, Si) 


< -|-oo 


2=1 


for SLLN for associated variables. 













12 


HAROUNA SANGARE AND GANE SAME LO 


Now, to sum up, the comparison between {GCIP) and {GCHR) is as 
follows 

1 For independent case the two conditions are equivalent. 

2 In negatively associated case, the form of {GCIP) for indepen¬ 
dent case remains valid. And we have no information whether 
the max—variance property holds to be able to apply {GCHR). 

3 For association with strictly stationary of sequences, {GCIP) 
gives a better condition than {GCHR). 

4 For association with no information on stationarity, so {GCHR) 
cannot be applied unless a max — variance property is proved. 
Our condition still works and is the same as for the stationary 
associated sequences in point 3. 

5 For arbitrary sequences with hnite variances, point 4 may be 
recontacted. 

In conclusion, our method effectively brings a significant contribution 
to SLLN for associated random variables. And we are going to apply 
it to an associated sequence in the extreme value theory helds. 

5. Applications 


5.1. Application to extreme value theory. The EVT offers us the 
opportunuity to directly apply our general conditions fl4.ip and 04.21) to 
a sum of dependent and non-st at ionary random variables and to show 
how to proceed in such a case. 

We already emphasized the importance of the parameter z/ = (1 — 5)/2 
in {GCIP). In the example we are going to treat, we will see that a 
conclusion cannot be achieved with z/ = 0 . 


Let Ei,E 2 ,... be an inhnite sequence of independent standard expo¬ 
nential random variables, f{j) is an increasing function of the integer 
j > 0 with /(O) = 0 and 7 > 0 a real parameter. Dehne the following 
sequences of random variables 

(5.1) 


fc -1 

M4 = ^ m 

i=i 


k-l \ / fc-1 

exp I -7 ^ Eh/h -exp -'j'^Eh/h 


h=j+l 


h=j 


1 k >1. 
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The characterization of the asymptotic behavior of (15.ip has important 
applications and consequences in two important helds : the extreme 
value theory in statistics and the central limit theorem issue for sum 
of non stationary associated random variables. Let us highlight each 
of these points. 


On one side, let X,Xi,X 2 ,... be independent and identically random 
variables in Weibull extremal domain of parameter 7 > 0 such that X > 
0 and let Xi^^ < ^ 2 ,n < ••• < W,n denote the order statistics based on 
the 77, > 1 observations. The distribution function G of Y = log X has 
a hnite upper endpoint uq and admits the following representation : 

, K G (0,1) 

where c is a constant and, p{u) and b{u) are functions of m G (0.1) such 

that (p(m),6(m)) —)■ 0 as m —)■ 0. This is called a representation of a 
sequence of random variables in the Weibull domain of attraction. 


(5.2) Dq — G ^{1—u) = {l+p{u)) 


exp 


To stay simple, suppose that p{u) = b{u) = 0 for all u G (0,1) consider 
the simplest case 

(5.3) 7/0 ~ G~^(l — u) = vd, u G (0,1). 


The so-called Hill’s statistic, based on the identity function id{x) = x 
and the k largest values with 1 < k < n, 

1 ^ ^ 

(5.4) Tn{id) = (log W-j+i, n - log W-y n) 

is an estimator of 7 in the sense that 

^ 

(yo — log Xn-k, n) 

as n —)■ -l-cxo. When we replace the identity function with an increasing 
function /(j) of the integer j > 0 with /(O) = 0, we get the functional 
Hill’s estimator dehned as 

k 

(5.5) TP/) = V fU) i\ogXn-,+i, n - \ogXn-j, n) 

1 ,=1 


introduced by Deme E., Lo G.S. and Diop, A. (2012) (see [3]). From 
this processus is derived the Diop and Lo (2006) (see |1]) generalization 
of Hill’s statistic. We are going to highlight that f {k)Tn{f)/{yo — 
log Xn-k, n) is of the form of fl5.ip when fl5.3p holds. We have to use two 
representations. The Renyi’s representation allows to hnd independent 
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standard uniform random variables Ui,U 2 ,--- such that the following 
equalities in distribution hold 

{logF„ j>l}=, j>l} 


and 


{{logX„_j+i, n, 1 < j < n}, n> 1} =d {{G ^(1 - f/,- „), l<j<n}, n 

Next, by the Malmquist representation (see ([H]), p. 336), we have for 
each n > 1 , the following equality in distribution holds 

{j“Mog(t/,+i, njUj, n), l<j<n}=d l<j< n}, 

where Ej^\ 1 < j < n, are independent exponential random variables. 
We apply these two tools to get that for each hxed n and k = k{n) 


(5.6) 


Uf) 

{yo - logXn-k, n) 


d hhfc(ji). 


For an arbitrary element of the Weibull extremal domain of attraction, 
it may be easily showed that /(fc)T„(/)/(?/o — log X^-k, n) also behaves 
as fl5.ip if some extra conditions are imposed of the auxiliary functions 
p and b. Hence a complete characterization of the asymptotic bevahior 
of (15.11) provides asymptotic laws in extreme value theory. On another 


side, easy algebra leads to 


fc-i 


k-l 


Wk = f{k - 1) + ^ A/(j)exp -'y^Eh/h , 


i=i 


h=j 


where A/(j) = /(j) — f{j — 1 ), j > 1 . We consider 
(5.7) 


fc-1 


W: = Wk-E{Wk) = J2^f(j) 

i=i 


fc-i 


fc-i 


exp -^'^Eh/h -E 


exp —7 


h=j 


5 : a 

h=j 


This is a sum of non stationary dependent random variables. In fact 
the rn’s 


A/(J) 


k-l 


k-l 


exp -'f^Eh/h - E 


exp —7 




h=j 


h=j 


are associated. 










A GENERAL STRONG LAW AND APPLICATIONS 


15 


Now, we are going to apply our general conditions to ( I5.8p . defined 
below 


(5.8) 

fe -1 

j=i 


fc-i 

exp 1 --f'^Eh/h 

h=j 


k-l 

E exp I -7 ^ Eh/h 

h=j 


a{k), 


where a{k) is a sequence of positive real numbers. Next, we will par¬ 
ticularize the result for /(j) = j’", r > 0. Our results depend on com¬ 
putation techniques developed in [H]. Here are our results : 


Proposition 2. Suppose that, for L and q large enough such that L < 
the following conditions hold for some 5, 0 < 5 < 3. 


(5.9) 


sup 

k>L 


a‘^{k) 

J^2'y+l+i/ 


k-l 


j=L 


< + 00 , 


(5.10) 

(5.11) 


fc -1 


a‘^(k) 

j=L+l 


k>L 


E A/(o 

.i=L 


^fU)- < 

J 


sup 

k>L 


a^ik) 

ki+u 


< +'^1 

L<j<k—1 


and 

(5.13) 


(5.12) sup ^ a^{k)A‘^f{q^ + t) 


< -|-oo 


2 / 7 \ 2 g-t-l 


a‘^{k) 


E 


sup sup / 

k>l (g2 + l)<fc<(g+l)2 q'^'^ ) ^ 

Then 


i-i 


^A/(g2 + i) 


2=1 


A/(g^+j)^— < +00. 

r + J 


St 


—)■ 0 a.s. 


Further, if 


k-l 


k-l 


Fk = '^a{k)Af (j)Eexp -j'^Eh/h p. 


i=i 


h=j 


where fi is a finite, then 
^^ 

k~^^a{k)Af (j)exp (--f^Eh/h 
j=l \ h=j 


—y fx d.s. 
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Proposition 3. For f{j) 
hold, a{k) = 


k-l 






= y, if ( [5.g|) . ( (J.iil) . and 

and z//i = r/(r + 7). Then 

' k-l \ 


-7 5 ; EJh 

^ h=j / 


-)■ 


r 


7 + 1 


a.s. as k ^ +cxo. 


Remark 5. Since these results are only based on moments, the a.s. 
convergence remains true for Tn{f)/{yo — \og Xn-k,n) in vertue of H5.6\) . 

We get under the model that 

^ (</*) ^ 

7-r-—TT-T —- n.s. as n ^ +00 and k = kin) +00 and k/n —)■ 0 

iyo-\ogXn-k,n) 7 + 1 

under the assumptions 115.9\) . 115.10\) . 1)5.11\) . h5.12i) and \5.13[) . in the 
general case. 

Remark 6. This strong law may he easily checked by Monte Carlo 
simulations. For example, consider 7 = 2 and r = 1. We observe 
the following errors corresponding to the values of 50, 75 and 100 of 
k : 0.358, 0.321 and 0.3332. This shows the good performance of this 
strong law for the particular values 7 = 2 and r = 1. 

5.1.1. Proofs. Both proofs of the two propositions are postponed in the 
Appendix Section . 

6. Conclusion and Perspectives 

We have established a general SLLN and applied it to associated vari¬ 
ables. Comparison with SLLN’s derived from the Hajek-Renyi ineqnal- 
ity proved that this SLLN is not trivial. We have also used it to hnd 
the strong convergence of statistical estimators under non-stationary 
associated samples in EVT. 


It seems that it has promising applications in non-parametric statistic, 
when dealing with the strong convergence of the empirical process and 
the non-parametric density estimator for a stationary sequence with an 
arbitrary parent distribution function. 

7. Appendix 

7.1. Proofs of Propositions and [3l 
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7.1.1. Assumptions. We have to show that the assumptions of Propo¬ 
sition |2] entail the general condition [GCIP). We hrst remind that 


k-l 




1=1 


exp 


k-l 

h=j 


Eexp 


k-l 

h=j 


a{k) 


that we write as 


k-l 

(71) Sl = Y,a{k)i\S{3)(S,,t-s,,t), 

1 = 1 

where Sj^k = exp (^-7 Y!h^j ^h /and a: = E exp (^-7 Ylh=] ^h/■ 
Next, we are going to check fl4.ip and fl4.2p for this sum of random vari¬ 
ables. Fix 0 < 5 < 3. Let us split fl7.ip into 

L—1 k—1 

Sl = Yl 1 - V 1) + E o(fc) A/(j) (S,, t - Sj, J 

1=1 j=L 

=: Si + Si 

Then for z/ = (1 - 5)/2 with 0 < 5 < 1, 
p^Var(S;) = l^Var (Si) + ^Var (7) + J^cov (7.7) 

=: Ak + Bk + 2Ck. 

Let us treat each term in the above equality. Here, we use Formulas 
18 and 21 in [ 6 ] and take L large enough to ensure 

/ ■ \ 27 

(7.2) Vor(7,)=f^j V{l,j)V{2,3), 

with 

|H( 1 , j)| = 1 + 0{rl and 0 < H( 2 , j) < . 

J 

And 

(7.3) Cov{Sj^ fc, Sj+e, k) = ^ar {Sj+e, k) (^—(1 + 0{rD. 

We suppose that L is large enough so that |H(l,j)| < 1/2, for j > L. 
First we see that 


( 7 . 4 ) 


Afc —)■ 0, as k ^ -|-cx). 















18 


HAROUNA SANGARE AND GANE SAME LO 


since Var(Sl) is let constant with L. Next, split into 


fc-i 


Bu — 


ki+i 


^ a‘^{k)A‘^f{j)Yar (S'j- k - Sj, k) 


j=L 


ki+v 


a\k)Af{j)Af{t)Cov (5,, fc, % 


L<i^j<k—1 


Bk, 1 + -Bfc, 


2 - 


By (O we get 
(7.5) 


k-l 


Bk, 1 — 


kl + T^ 


'^a^{k)A^f{])Yar{Sj^k) < '^A^f{])fA 

j=L j=L 

Now let us turn to the term Bk, 2 - Let us remark that the rv's Sj, k are 
non increasing functions of independent rv’s Ej. So they are associated. 
We then use the Lemma 3 of Newman [13] stated in Lemma [1] to get 

Cov exp --f'^Eh/h , exp -'j'^Eh/h 


h=i 


h=j 


( k-l k-l \ 

l^Eh/h, 'y'^Eh/hj , 

h=i h=j / 

where we use the one-value bound of exp{—x). For i < j, 
(7.6) 


k-l 


k-l 


k-l 


k-l 9 

2N-7.-2 / r 


Cov -f^Eh/h, ^^Ehjh = Var ^ h ^ , 


h=i 


h=j 


h=j 


h=j 
yk-l , _2 


the latter inequality is directly obtained by comparing ^ ^ 

'•k -2 


J. X ‘^dx. We get 


k-l 


k-l 


\Bko\ < 


kl+v 


a^{k)Af{j)Af{i)Cov -^YEh/K lY^^!'^ 


L<i^j<k 


h=i 


h=j 


< 


27^ 

kl+v 




L<i<j<k 


o 9 ^“1 

^ E 

j=L+l 


kl+v 


i=L 


AfU)-. 


(7.7) 
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Finally, by using the techniques of (17.hh and (17.7p . we get 

aHk)Af(,i)Af(j)Cov(Si,,, S,_,) 


(7.8) 


l<i<L-l L<j<k-1 


< 


ki+k 


E 


E 




L<j<k-1 \.l<i<L-l 

where [X]i<i<L-i'^/(*)] is a constant. By putting together fl7.4p . fl7.5p . 
07.71) and Ot'si) . we get that assumptions 05.9p . 05.10p and 05.111) entail 
04.11) in Theorem 01 We are going to check for 04.2p now. We already 
noticed that the rv’s a{k)/S.f\q^ + i){Sk, q^+i — q 2 +i) are associated 

and partial sums of associated rv’s have non decreasing variances. Then 
for j < 2g + 1, we have 

Yar (e T l) q'^+i ^k, g^+i) 

/2q+l 

< Yar (E a{k)Af{q^ + z) {Sk 


And 04.21) becomes 
(7.9) 


sup 


sup 


/2q+l 


k>l (g2 + l)<fc<(g+l)2 q 


(3-5) 


Yar I ^2 ^ik)Af{q^ + i) {Sk, 


\ 2=1 


We £x q but large enough to ensure > L, where L is introduced in 

07.21) . So 07.9P is bounded by 

(7.10) 


sup 

(g2+l)<fc<(g+l)2 > 

Now, we only have to show that 


/2q+l 

Yar f ^ a{k)Af{q^ + i) 

q'^+i ^k, g2+j) | • 


D = 


sup 

(g2+l)<fe<(g+l)2 g'' ’ 

is bounded for q^ > L. Let us split term in the brackets into 


/2q+l 


Yar a{k)Af{q^ + i) {Sk , g2+j g2-|_j) 


2q+l 


D = 


7(3-5) 


^ a^{k)A^f{q^ + i)Yar {Sk, q^+i) 


2=1 


7(3-5) 


^ a^{k)Af{q^ + i)Af{q^ + j)Cov{Sk,q2j^u Sk,q^+j) 


l<i^j<2q+l 
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—; Di + D2- 

We have, by (1721), 

. 2g+l 

Di = + OVar {Sk, g2+i) 

^ i=i 


1 / 2 _|_ -X 27 

(7-11) <(l/2)^E«W/(g^ + *)(^) • 

Now, we handle D 2 . We use again the techniques that lead to (17.71) 
based on the Newman’s Lemma to get, for i < j, 

1 f 

1^2! S “M E a"(*:)A/(«"+*)A/(,"+i)Var 7 E,/h 

^ l<>^J<2q+l \ h^qq+j 

We remind, as in fl7.6p . that 



2(7+1 


Var(7 Y, Eklh] <7Vtf + j) 

h=q'^+j 


and then 


|7^2| < A/(g2 + ,)A/(g2+^')^^ 

^ l<*<i< 2 q+l ^ 


(7.12) 


27= 

q{3—5) 


a 


2q+l 

wE 


i=2 


^ A/(g 2 + i) 


2 = 1 


A/(g^ + j) 


1 

g2 + j ■ 


By putting together (17.111) and (17.121) . we get that assumptions (I5.12p 
and (15.131) entail (14.2p in Theorem 01 We may conclude that the strong 
law of large numbers holds for S^. 


7.1.2. Special case for /(j) = j"’". We are going to check the conditions 
(15.91) . (I5.10p . (15.lip . (I5.12P and (I5.13P for the special function /(j) = j"’", 
r > 0. We hx L as indicated, consider q > L and work with fc > +1. 

We notice that Af{j) is equivalent to and A/(g^+j) is uniformly 
equivalent to uniformly in j > L. Here a{k) = k Then (15.9|) 

holds when 


sup 

k>L 


T 


2 


J^2^+2t-1+u 


k-1 


E 2 


27+2r-2 
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is bounded. But if 27 + 2r — 1 = 0, we get 


k-l 




j ^ ~ ^ log /c —)■ 0 


j=L 


and for 27 + 2 r — 1 7 ^ 0 , we get 


k-l 


j^ 27 + 2 r—l+i' 


^^■27+2r-2 _ ^-.^27 + 2r - 1)-^ 


j=L 


and fl5.9p holds. (I5.10p holds with boundedness of 




fc-i 

El 

j=L+l 


2t-2 


which is, for 2 r — 1 7 ^ 0 


2r - 1 


^ 0 , 


and for 2 r = 1 


k ^ In fc —)■ 0 . 


Next fIS.lip is equivalent to the boundedness of 


k-l 


^ 2 t— l+z/ 




j=L 


which is equivalent to the boundedness of log k, for r — 1 = 0 

and to that of for r — 1 7 ^ 0. Let us now handle fl5.12p which is 

equivalent to the boundedness of 


2 g+l 


7(3-<5) 


a 


WE 


3=2 Li=l 


i -1 


^A/(g 2 + z) 


A/(g^ + j) 


q + 3 


2q+l 


< 


q 


(3-5) 


a 


WE 




^A/(g 2 + i) 


A/(g^ + j) 


j=i Lwi 

for q large enough. We have to establish that 

1 T 2 g+l 


q^+j 


sup sup 


;>1 (q^+i)<7<(,+ir U 


Y.{q^ + <+00. 


If 27 + 2r - 1 7 ^ 0, then 
bounded whenever 

1 1 ;(; 27 + 2 r-l ^ 


1 1 ^fc-(2fc+l-<?^)j'^2 _|_ j^ 27 + 2 T -2 j 


IS 


g(3-'5) A:27+2r-2 27 + 2r - 1 27 + 2r - 1 


{k/q )q 


2W-(i-5) 
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is bounded. And if 27 + 2r - 1 = 0, is 


bounded along with 



In both cases, {k/q^) q ~ g 0 as fc (and q) goes to inhnity. 

The proof is now complete. 
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